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We present a search for B decays to charmless final states involving an r\ meson, a charged pion 
and a second charged pion or kaon. The data sample corresponds to 383 xlO 6 BB pairs collected 
with the BABAR detector operating at the PEP-II asymmetric-energy B Factory at SLAC. We find 
no significant signals and determine the following 90% C.L. upper limits: B(B° — > a^-K + ) x B(a^ —* 
7J7T-) < 3.1 x 10~ 6 , B(B° -> a^K+) x B(ao -> 7J7T - ) < 1-9 x 10" 6 , B(B° -> a (1450)~7r + ) x 
B(ao(1450)" -> 777T-) < 2.3 x 1(T 6 , 73(5° -> a (1450)"_ft: + ) x /3(a (1450)~ -> 7771") < 3.1 x 10~ 6 , 
-> 77p°) < 1.5 x 10~ 6 , and B(B° -> 17/0 (980)) x B(/ o (980) -> tt+tt") < 0.4 x 10" 6 . 

PACS numbers: 13.25.Hw, 12.15.Hh, 11.30.Er 



We investigate the decays of a B° meson to final states 
with an rj meson, a charged pion, and either a second 
charged pion or kaon. The Dalitz plots for the decays 
without an intermediate charmed meson are expected to 
have contributions from quasi-two-body decays such as 



a n 7T 1 



-K+, B a 



VP 



B' 



77/0, and B° 



The last of these has been investigated 
recently so in this paper we concentrate on the others, 
where ao is either a (980) or a (1450) and /o is /o(980). 
Measurements of B decays involving a scalar meson are 
interesting since they provide information on such B de- 
cays and the nature of scalar mesons. Several B decays 
involving scalar mesons have been observed, either with 
an / (980) |,[3 or K*(U30) @ in the final state. 

Specific predictions can be made for the decays B — > 
doir if factorization is assumed and if the decay involves 
only tree or penguin (loop) processes. The dominant 
amplitude is shown in Fig. [Ha). The companion tree 
amplitude, shown in Fig. QJb), is expected to be greatly 
suppressed, since, neglecting light-quark mass splittings, 
the virtual W cannot produce an ao meson Q . This is a 
firm prediction of the Standard Model because the weak 
current has a G-parity even vector part and a G-parity 
odd axial- vector part. The latter can produce an axial- 
vector or pseudoscalar particle while the former produces 
a vector particle, but neither can produce a G-parity odd 
scalar meson (e.g. ao). Thus the decay B — > aoir is ex- 
pected to be "self-tagging" (the charge of the pion iden- 
tifies the B flavor). Penguin processes such as shown 
in Fig. [He) are allowed, but are suppressed relative to 
the tree processes. The decays with a kaon in the fi- 
nal state should be dominated by the penguin processes 
(Fig. [He)), though there is a cancellation between two 
terms in the penguin amplitudes for these decays [3]. 

The theoretical expectations for these decays with an 
ao (980) meson 0, JEM E3] are larger than previous ex- 
perimental limits [la ]. The decays with a p° meson are 



expected to have branching fractions < 1 x 10 [11 1 
since they are dominated by color-suppressed tree ampli- 
tudes (Fig. [ljd)). There are no predictions for the decay 
B° — > 77/0, but it should have a small branching fraction 
for the same reason. 

The nature of the ao meson is not well understood. It 
is thought to be a qq state with a possible admixture of a 
KK bound-state component due to the proximity to the 
KK threshold [3 El. The ao mass is known to be about 



u 



W 



I. 



"(I 



(a) 



(b) 





P ,V 



(c) 



(d) 



FIG. 1: Feynman diagrams for decays involving charged ao 
mesons: (a) dominant and (b) G-parity-suppressed tree dia- 
grams for B° — > cLqTt^ 1 , (c) penguin diagram for B° — > aj 71 ^ 
and B° — > a.Q K + (a tree diagram similar to (a) also con- 
tributes to B° — » a,Q K + ), (d) tree diagrams for B° — > 77P 
(B° — » 77/0 is similar with the p° being replaced by a /o). 



985 MeV with a width of 71±7 MeV [l4| for the dominant 
ao — > ?77r decay mode 11211 . The ao(1450) has a measured 
width of 265 MeV [P2J. Since the branching fraction 
for ao — > 777T is not well known, we report the product 
branching fraction B(B Q — * X + ) x £>(ao — * 7771"), where 
X indicates K or tt. The properties of the Jo (980) meson 
are well measured for the 7r + 7r~ channel that is used in 
this analysis [loT ]. 

Only limits for the following decays have been reported 



previously: B° 
[HI and B° 



tt- and B° -> 00(980)-^+ 
19l | . There have been no 
77/0 or the decays with an 



previous searches for B° 
ao(1450). The results presented here are based on data 
collected with the BABAR detector 20] at the PEP-II 
asymmetric-energy e + e~ collider located at the Stanford 
Linear Accelerator Center. An integrated luminosity of 
approximately 347 fb _1 , corresponding to 383xl0 6 BB 
pairs, was recorded at the T(AS) resonance (center-of- 
mass energy a/s = 10.58 GeV). 

The track parameters of charged particles are mea- 
sured by a combination of a silicon vertex tracker, with 
five layers of double-sided silicon sensors, and a 40-layer 
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central drift chamber, both operating in the 1.5T mag- 
netic field of a superconducting solenoid. We identify 
photons and electrons using a CsI(Tl) electromagnetic 
calorimeter (EMC). Further charged particle identifica- 
tion (PID) is provided by measurements of the aver- 
age energy loss (dE/dx) in the tracking devices and by 
an internally-reflecting, ring-imaging Chcrenkov detector 
(DIRC) covering the central region. 

We select ao candidates from the decay channel ao — > 
rjir with the decays 77 — ► 77 (»7 77 ) and 77 — ► 7r + 7r~7r (773^)- 
All charged tracks are required to originate from a com- 
mon vertex. For the decays B° — > 77/3° and -B — > 77/0, 
we use the same 77 decay modes and p° — > tt + it~ or /q — > 
7r + 7T _ . We apply the following requirements on the in- 
variant masses (in MeV) relevant here: 500 < m 77 < 585 
for ?7 77 , 535 < rriinrir < 560 for 773^, 120 < m 77 < 150 for 
7T°, and 510 < < 1060 for p°// . For the a (980) 

analysis we use a mass range 775 < TO, ;7r < 1175, while 
for ao(1450) we require 775 < ?7i, ;7r < 1750 (the latter up- 
per limit removes unwanted background from D decays). 
These requirements, except for ir°, are quite loose com- 
pared with typical resolutions in order to achieve high 
efficiency and retain sufficient sidebands to characterize 
the background for subsequent fitting. 

We make several PID requirements to ensure the iden- 
tity of the pions and kaons. Secondary tracks from 77, p , 
or fo decays must have measured DIRC, dE/dx, and 
EMC outputs consistent with pions. For the B° — > <Zq 7t + 
(B° — ► ag K + ) decays, we require an associated DIRC 
Cherenkov angle between —2 and +5 (—5 and +2) stan- 
dard deviations (a) from the expected value for a pion 
(kaon); the requirement is more restrictive on the side 
where there is kaon (pion) background. The distribu- 
tions are corrected as a function of momenta and angles 
so that the distributions are normalized Gaussians. 

A £?-meson candidate is characterized kinematically 
by the energy-substituted mass toes = {\ s — Ps) 5 an d 
energy difference AE = Eb — \y/s, where (Eb,Pb) is 
the B-meson 4-momentum vector and all values are cal- 
culated in the T(45) frame. Signal events peak at zero 
for AE, and at the B nominal mass for toes- The AE 
(raEs) resolution is about 30 MeV (3.0 MeV). We require 
\AE\ < 0.2 GeV and 5.25 < to es < 5.29 GeV. 

Backgrounds arise primarily from random combina- 
tions in continuum e + e~ — > qq (q = u, d, s, c) events. We 
reduce these by using the angle 9t between the thrust 
axis of the B° candidate in the T(45) frame and that 
of the rest of the charged tracks and neutral clusters in 
the event. The distribution of | cos#t| is sharply peaked 
near 1.0 for combinations drawn from jet-like qq pairs, 
and nearly uniform for i?-meson decays. We require 
|cos#t| < 0.7 (0.8) for the T7 77 (773^) channels. We also 
use, in the fit described below, a Fisher discriminant T 
that combines the angles of the candidate direction with 
respect to the beam axis of the B momentum and B 
thrust axis (in the Y(AS) frame), and moments describ- 



ing the energy flow about the B thrust axis [21]. 

We use additional event-selection criteria to further 
reduce backgrounds from charmless B decays. For the 
77 — > 77 modes we require |cos^ cc l < 0.86, where 61 
is the angle of the photons in the 77 rest frame with re- 
spect to the direction of the particle recoiling against 
the 77. We also require |cos6^° c | < 0.8, where 9^ c is 
defined similarly to #2 GC . For B° — ► 77/5 decays, we de- 
fine Ti to be the magnitude of the cosine of the angle 
between the pion from the p and the B° momentum in 
the p rest frame, and require TC < 0.75 to remove back- 
ground from B° — > D + (rjir + )ir~ . These additional re- 
quirements reduce the backgrounds by a factor of 2-4, 
depending on the decay mode. We use Monte Carlo (MC) 
simulation 22] for an estimate of the residual BB back- 
ground and to identify the few (mostly charmless) decays 
that survive the candidate selection and have character- 
istics similar to the signal (20 — 270 events, depending on 
mode). We include a component in the fit to account for 
them. 

We obtain yields and branching fractions from ex- 
tended unbinned maximum-likelihood fits, with input ob- 
servables AE, toes, m res for the ao(1450) fits, these ob- 
servables plus T for the ao(980)fits, and these plus TL 
for the rjp°/r]fo fits. The observable m rcs denotes the 
777T mass for the ao analyses and the 77 and ir + ir~ masses 
for the r)p°/r]fo fits. We employ separate fits to deter- 
mine the ao(980) and ao(1450) yields since this results 
in -20% better sensitivity for a (980). The a (1450) fit 
has a component for a (980) with the yield fixed to the 
value found in the ao(980) fit, corrected for the small effi- 
ciency difference. No a (1450) component is used for the 
ao (980) fit since none of the subsamples have evidence of 
ao(1450) signals. 

For each event i and hypothesis j (signal, continuum 
background, BB background), we define a product of 
probability density functions (PDF) 

V) =V j (m BS i )V j (AE i )V j (miJ [Pj^)] [P^W)] . 

(1) 

The bracketed variables T and Ti are not used in all fits. 
For all decays except for those involving ao(1450), the ab- 
sence of significant correlations among observables in the 
background is confirmed with the background-dominated 
data samples entering the fits. For the ao(1450) decays, 
we find a substantial correlation in data between T and 
the 777T invariant mass, due to the large rjir mass range. 
We therefore require T < for these modes, which keeps 
90% of the signal, and exclude T from the fit. For the 
signal component, we correct for effects due to the ne- 
glect of small correlations (more details are provided in 
the systematics discussion below). The BB background 
yield is free in the r]p°/r]fo fits and is found to be in 
agreement with expectations from MC simulations. For 
the decays involving ao mesons, we fix the BB yield to 
the value predicted by MC and include the uncertainty 
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in the systematic errors (see below). 
The likelihood function is 



N 



£ = exp(-^y})]][ 



(2) 



where Yj is the yield of events of hypothesis j that we 
find by maximizing C, and N is the number of events in 
the sample. 

We determine the PDF parameters from simu- 
lation for the signal and BB background compo- 
nents. We parameterize each of the functions 
£sig(wEs), "Psi g (A£;), Vj(F), and :P s ig(m rC s) with ci- 
ther the sum of two Gaussian functions, a Breit-Wigner 
shape, or an asymmetric Gaussian function, as required 
to describe the distribution. V s i g (H) for B° — > ryp 
is described by a second order polynomial. The shape 
of the real-meson component of Vj(m res ) in the com- 
binatorial background is described with the same pa- 
rameters as for signal. The distributions of to ics , AE, 
and Ti for BB and combinatorial background are repre- 
sented by second order Chebyshev polynomials and/or 
the sum of two Gaussian functions. The qq combina- 
torial background in toes is described by the function 
f(x) = x\J\ — x 2 exp [— £(1 — x 2 )], with x = 2to,es/\/s 
and free parameter £; for peaking BB background, gen- 
erally with the same or similar final state as signal, we 
add a Gaussian function to the quantity f{x). 

Large control samples of B — > Dir with a topology 
similar to the signal are used to verify the simulated res- 
olutions in AE and rn.Es- Where the control data sam- 
ples reveal small differences from MC, we shift or scale 
the resolution used in the likelihood fits. Examples of 
many of these PDF shapes from a similar analysis are 
shown in Ref. [211] . Additionally, the signal parameters 
for the a (980) mass (983.5 MeV) and width (80 MeV) 
are determined from an inclusive dataset that is much 
larger than the sample used for this analysis; they are 
consistent with expectations from the natural-width val- 
ues of Ref. 14J. The values for ao(1450) are taken from 
Ref. 0. 

In Table [J we show for each decay mode the measured 
product branching fraction, together with the quantities 
entering into its determination. In order to account for 
the uncertainties in the background PDF parameteriza- 
tion, we include as free parameters in the fit, in addition 
to the signal and background yields, the principal param- 
eters describing the background PDFs. These include 
slopes for the polynomial shape for the AE and m TCS 
distributions, the parameter £ used for rn.ES) and three 
parameters describing the asymmetric Gaussian function 
for T . For calculation of branching fractions, we assume 
that the decay rates of the T(\S) to B+B- and B°B° 
are equal [Hj]. We combine branching fraction results 
from the two r\ decay channels by adding the values of 
— 21n£, adjusted for a fit bias (see below) and taking 



proper account of the correlated and uncorrelated sys- 
tematic errors. We quote 90% confidence level (C.L.) 
upper limits, taken to be the branching fraction below 
which lies 90% of the total of the likelihood integral in 
the positive branching fraction region. 
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FIG. 2: Signal-enhanced projections of the B°-candidate 
mBS and rjir mass for (a, b) a^"7r + , (c, d) K + , (e, f) 
ao(1450)"7r + , and (g, h) a (1450)~ K + . Points with errors 
represent data, solid curves the full fit functions (both sig- 
nal modes combined), and dot-dashed curves the background 
functions (the peaking BB background component is small). 
For the Oo(1450) plots, the ao(980) signal is included in the 
background curves. These plots are made with a minimum 
requirement on the likelihood that has an efficiency for signal 
of 60-70%. 

In Fig. [5] we show projections onto jties and rjir mass of 
subsamples enriched by a mode-dependent threshold re- 
quirement on the ratio of signal to total likelihood (com- 
puted without the variable plotted). We show analo- 
gous projections of toes and the 7r + 7r~ invariant mass in 
Fig. El 

The significance is taken as the square root of the dif- 
ference between the value of — 21n£ (with additive sys- 
tematic uncertainties included) for zero signal and the 
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TABLE I: Signal yield with statistical error, fit bias, detection efficiency e, relevant daughter branching fraction product 
significance (including additive systematic uncertainties), measured branching fraction B, and the 90% C.L. upper limit on this 
branching fraction. For the ao and fo modes, B includes the daughter branchings fractions for ao — * t]tt or fo — » tt + tv~ . 



Mode 


r it yield 


Bias 


e 


11 Bi 


Bignu. 


K3 
D 


H TT T 

D V.L. 




(events) 


(events) 


Co/ \ 
(/o) 


(<V \ 
{/a) 




(10 ) 


f-i n— 6\ 
(10 ) 


O (980)~7T + 
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2.1 ± 0.8 ± 0.3 
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a (980) 77 7r + 


87 ±23 


16 
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a (1450)"7r+ 










— 


-3.5 ± 2.2 ± 0.8 
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-47 ± 56 


26 


13.8 
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22 ±36 
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39.4 
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FIG. 



3: Signal-enhanced projections of the B°-candidate jties 
and tv + tt~ mass for (a, b) rjp and (c, d) r/fo- Points with er- 
rors represent data, solid curves the full fit functions (both sig- 
nal modes combined) , and dot-dashed curves the background 
functions (the peaking BB background component is small). 
These plots are made with a minimum requirement on the 
likelihood that has an efficiency for signal of 70-90%. 



value at the minimum, with other parameters free in both 
cases. 

Most of the yield uncertainties arising from lack of 
knowledge of the PDFs have been included in the sta- 
tistical error since most background parameters are free 
in the fit. Varying the signal PDF parameters within 
their estimated uncertainties, we determine the uncer- 



tainties in the signal yields to be 0-9 events, depending 
on the final state. This uncertainty is substantial only 
for the modes with one of the ao resonances, where it 
is dominated by uncertainties in the parameterization of 
the ao signal shape. The neglect of correlations among 
observables in the fit can cause a systematic bias; the cor- 
rection for this bias (between —4 and ±26 events) and as- 
signment of the resulting systematic uncertainty (0.1-13 
events) is determined from simulated samples with vary- 
ing background populations. For the ao modes where 
the BB background yield is fixed, we estimate the un- 
certainty from modeling the BB backgrounds by varying 
the expected BB yield by 100% (0.1-12 events). 

The above uncertainties are additive in nature and af- 
fect the significance of the results. Multiplicative un- 
certainties include our knowledge of the efficiency and 
other quantities entering the branching fraction calcu- 
lation. Selection efficiency uncertainties are 1-2% for 
cos#t and 0.5-0.8% due to the limited size of the MC 
samples. Uncertainties in the reconstruction efficiency 
found from auxiliary studies on inclusive control sam- 
ples [HI, include 0.5%-N t and 1.5%-iV 7 , where N t and 
iV 7 are the number of signal tracks and photons, respec- 
tively. The uncertainty on the total number of BB events 
is 1.1%. Published data provide the uncertainties in 
the B-daughter product branching fractions (1-2%). 

In conclusion, we do not find significant signals for the 
i3-meson decays presented here. The measured branch- 
ing fractions and 90% C.L. upper limits are given in Table 
HI The limits for the ao(980) channels are smaller than 
expectations 0, H, @, [l£|. This has been cited as evi- 
dence that the ao(980) meson is a four-quark state, not 
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the lowest- lying member of the qq scalar multiplet 
The limits for the ao(1450) channels and B° — > ijp are 
consistent with theoretical expectations There 
are no previous measurements or theoretical predictions 
for the B° — ► i]f decay. 
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